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Abstract 

Bessel-type convolution algebras of bounded Borel measures on the matrix cones of 
positive semidefinite g x g- matrices over M, C, H were introduced recently by Rosier. These 
convolutions depend on some continuous parameter, generate commutative hypergroup 
structures and have Bessel functions of matrix argument as characters. Here, we first 
study the rich algebraic structure of these hypergroups. In particular, the subhypergroups 
and automorphisms are classified, and we show that each quotient by a subhypergroup 
carries a hypergroup structure of the same type. The algebraic properties are partially 
related to properties of random walks on matrix Bessel hypergroups. In particular, known 
properties of Wishart distributions, which form Gaussian convolution semigroups on these 
hypergroups, are put into a new light. Moreover, limit theorems for random walks on 
these hypergroups are presented. In particular, we obtain strong laws of large numbers 
and a central limit theorem with Wishart distributions as limits. 

KEYWORDS: Matrix Bessel functions, product formula, hypergroups, automorphisms, 
subhypergroups, Wishart distributions, random walks on matrix cones, central limit theorem, 
strong laws of large numbers. 

1 Introduction 



Recently, Rosier R introduced positivity-preserving convolution algebras on the matrix cones 
nq(F) of positive semidefinite q x g-matrices over F = M, C,IH[ which are related with Bessel 
functions of matrix argument and depend on some continuous parameter. With respect 
to this parameter, they interpolate the radial convolution algebras on non-squared matrix 
spaces Mp^g{¥) with p > q which are, to some extent, studied in |FTj . The convolutions of 
generate commutative hypergroup structures on nq(F) with Bessel functions of matrix 
argument as characters; see [FT], |FK] |Hj and |Di| for matrix Bessel functions and |BHj, |j] 
for hypergroups. The present paper is devoted to algebraic and probabilistic aspects of these 
hypergroups. In particular we shall show that these hypergroups admit many subhypergroups 
and hypergroup automorphisms. Moreover, these algebraic properties are closely related with 
probabilistic properties of random walks on these hypergroups. In particular, some known 
properties of Wishart distributions will be seen under a new light. 
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Before going into detail, we recall the one-dimensional case: For any dimension p > 1, 
the Banach-*-algebra Mi,{MP) of bomided Borel measures on W with the usual convolution 
contains the space of all radial measures 

Mft™'^(MP) := {/i G Mfe(MP) : u{fi) = fi for all u € 0{p)} 

as a Banach-*-subalgebra. If we identify the set of all orbits under the standard action of 
the orthogonal group 0{p) on R^* with Hi := [0, oo[ via 

p : X \x\ = {xl + . . . + Xp)-*-/^, 

then p induces an isomorphism between the Banach spaces Mft™'^(MP) and Mb{Ui). We 
thus may transfer the Banach-*-algebra structure of M^"'^(R^) to Mh{Ili) which inherits 
a commutative, associative, probability preserving and weakly continuous convolution *p. 
Calculation in polar coordinates shows that for p > 1, 

5r*p5s{f) = Cp /{Vr"^ + s^- 2rs cos 9) sin^-^ 9 d9, r, s > 0, f £ C{Ui) (1.1) 
Jo 

with a normalization constant Cp > where for p = 1 (|l.lj) degenerates to 

Sr * Ss = ^iS\r-s\ + Sr+s) (r, s G M, r, s > 0) . (1.2) 

The convolution on Mb(ni) is then obtained by linear, weakly continuous extension. It is 
well-known that for all real p > 1, Ea. ()l.l() generates a commutative, probability preserving, 
and weakly continuous convolution algebra on M(,(M_|_) which interpolates the integer cases. 
These convolutions have no group interpretation and are closely related with the known 
product formulas 

ja{r)ja{s) = 6r *pSs{ja)- 

for the normalized Bessel functions ja{z) = oFi{a+l; —z'^ /4) with index a = p/2 — l > —1/2 
( |Wj ) . The space M+ with the convolutions *p for p > 1 provides a prominent class of 
commutative hypergroups, called Bessel-Kingman hypergroups ( |BHj ) . For p > 1, these 
hypergroups have no nontrivial subhyper groups while in the degenerated case p = 1 the sets 
cZ_|_ for c > form the nontrivial subhyper groups. Moreover, for p > 1, all hypergroup 
automorphisms are given by x i— > cx for c > 0, see |Z1) . Random walks on Bessel-Kingman 
hypergroups, i.e., Markov chains on M+ with transition probabilities given in terms of *p were 
investigated first by Kingman jKj; for the later development we refer to |BH) and references 
therein. Kingman in particular obtained laws of large numbers and a central limit theorem 
with a Rayleigh distribution as limit. For integers p, these limit theorems on are just 
radial reformulations of classical limit theorems on R^. 

We now turn to the higher rank case in For p,q £ N with p > q, consider the space 
Mp^q = Mp^q{¥) oipxq matrices over one of the division algebras F = M, C or the quaternions 
EI with real dimension d = 1,2 or 4 respectively. Mp^q is a real Euclidean vector space of 
dimension dpq with scalar product {x\y) = 9^tr(x*y) where x* = x*, 9\t = ^(t + 1) is the real 
part of t E F, and tr the trace in Mq{¥) := Mq^q{F). A measure on Mp^q is called radial if it 
is invariant under the action of the unitary group Up = Up{¥) on Mp^q by left multiplication. 

Up X Mp^q Mp^q , (u, x) ^ UX. (1-3) 
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This action is orthogonal w.r.t. the scalar product above, and x, y are in the same C/p-orbit 
if and only x*x = y*y. Thus the space of C/p-orbits is naturally parametrized by the cone 
rig = ng(F) of positive semidefinite q x (/-matrices over F. For q = 1 and F = M, we have 
Hi = and end up with the one-dimensional case above. We now use the projection 

p : Mp,g -^Ug, x^ {x*x)^/^, 

with the usual unique square root on Ug. Via this mapping the convolution algebra of radial 
measures on Mp g is transferred to a commutative, associative, probability preserving and 
weakly continuous convolution *p of measures on Ilg which forms a commutative hypergroup. 
By construction (and results of |FTj . |H] ) this convolution corresponds to a product formula 
for Bessel functions on the cone Ilg with index fi = pd/2. In j^, the convolution *p 
and the product formula for the corresponding is written down in a way which allows for 
analytic continuation with respect to the index. This leads to "interpolating" commutative 
hypergroup structures Xg^^ on Ilg with a continuous real index p > 2q, i.e. /i > d{q — 1/2) 
and with matrix Bessel functions of index fi as hypergroup characters. These hypergroups 
are self-dual with the identity mapping as involution. The product formulas degenerate for 
p = q,q + 1 . . . , 2q. For non-integer p €]q, 2q[ there is unfortunately only a guess for explicit 
product formulas; see 0. 

The present paper continues [H]. In the first place, we study algebraic properties of the 
matrix Bessel hypergroups of "Ri. We first show that for each a G GL(q, F), the map Ta{r) := 
(ar^a*)^/^ is a hypergroup automorphism of Xg^f^ This reveals that matrix Bessel hypergroups 
in higher rank admit a rich structure of automorphisms similar to the Euclidean spaces F'^. 
The deepest result will be the classification of all hypergroup automorphisms Aut{Xg^^) 
for F = M, C. Indeed, we shall prove that for F = M, Aut{Xg^^) is the transformation group 
{Ta : a G GL{q, F)}, and that for F = C in addition the maps roT^ appear with a £ GL{q, F) 
and T the complex conjugation. We expect a similar result for F = H, but we are unable to 
prove it here. In addition, we will classify all subhyper groups in the general case, that is for 
all F and /i > d{q — 1/2). More precisely, we prove that all subhypergroups are of the form 

Hk,u := |n ^ ^ II ^ n* : f G n^j 

with k >0 and a unitary matrix u ^ Ug (where -ffo.u = {0})- We also show that for fixed fi, 
Hj^ u is canonically isomorphic with the hypergroup X^,^^, and that the quotient Xk^^/H^^u 
carries a quotient hypergroup structure and is isomorphic with Xg-k,^i- The proofs of these 
algebraic properties will rely more on the properties of matrix Bessel functions (which form 
the hypergroup characters) rather than the explicit form of the convolution. 

The second part of this paper is devoted to probability theory on matrix Bessel hyper- 
groups. We there introduce convolution semigroups of probability measures and random 
walks and show how Wishart distributions fit into this concept. In particular, some known 
facts about Wishart distributions and Wishart processes will appear under a new light. More- 
over, these Wishart distributions will appear as limits in a central limit theorem. Besides 
this central limit theorem, we derive strong laws of large numbers for random walks on Xg^^. 
The proofs of both types of limit theorems are quite standard from a point of view of limit 
theorems on commutative hypergroups and rely on the concept of moment functions which 
was developed by Zeuner |Zlj . |Z2j and others; see also the monograph |BIIj . We point out 
that for the group case n = pd/2, all limit theorems are just radial reformulations of classical 
limit theorems on the vector spaces Mp^g. 
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This paper is organized as follows: In Section 2 we collect some basic facts about matrix 
Bessel functions and the corresponding hypergroups from ^ . Section 3 contains some general 
facts about hypergroups which will be useful for our concrete examples. In Section 4, the 
algebraic properties of matrix Bessel hypergroups are studied. The remaining sections are 
then devoted to probability theory on matrix Bessel hypergroups. Section 5 contains basic 
properties of convolution semigroups of probability measures, random walks, and Wishart 
distributions. In Section 6 we then derive a central limit theorem as well as strong laws of 
large numbers for random walks on matrix cones. 

Acknowledgement. It is a pleasure to thank Margit Rosier for many discussions and com- 
ments. 

2 Bessel convolutions on matrix cones 

Here we collect some basic notions and facts about matrix Bessel functions and matrix Bessel 
hypergroups from |FKj . |BHj . p], |R]. 

2.1 Bessel functions associated with matrix cones 

Let F be one of the real division algebras F = M, C or H with real dimension d = 1,2 
or 4 respectively. Denote the usual conjugation in F by t i-^ t, the real part of t G F by 
mt = ^{t + t), and \t\ = (ti)^/^ its norm. 

For p, g G N we denote by Mp^g := Mp^g(¥) the vector spaces of all p x q-matrices over F, 
and we put Mg := Mg^g. We consider the set 

Hg = Hg{¥) = {xe Mg{¥) i X = X* } 

of Hermitian q x g-matrices over F as a Euclidean vector space with scalar product {x\y) := 
^tr{x*y) and the associated norm ||x|| = Here x* := x* and tr denote the trace. 

Its dimension is given by dim^Hg = n := q + ^q{q — 1). Let further 

Ug := {x^ : X G Hg] = {x*x : x G Hg} 

be the set of all positive semidefinite matrices in Hg, and Qg its topological interior which 
consists of all strictly positive definite matrices. ^Ig is a symmetric cone, i.e. an open convex 
self-dual cone which whose linear automorphism group acts transitively, see |FKj for details. 

To define the Bessel functions associated with the symmetric cone ilg we first introduce 
their basic building blocks, the so-called spherical polynomials. These are just the polynomial 
spherical functions of 0,g considered as a Riemannian symmetric space. They are indexed by 
partitions A = (Ai > A2 > . . . > Xg) G Nq (we write A > for short) and given by 

^x{x) = / Ax{uxu^^)du, X e Hq 

JUq 

where du is the normalized Haar measure of Uq and A>, is the power function on Hq with 

Aa(x) := Ai(x)^i-^2A2(x)^^-^^ • . . . • Ag(x)^«; 

the Aj(x) are the principal minors of the determinant A(x), see |FKj for details. The ^\ 
are homogeneous of degree |A| = Ai + . . . + Xq. There is a renormalization Z\ = ca$a with 
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constants c\ > depending on the underlying cone such that 



(trx)'' = ^ Zx{x) for A: G No, (2.1) 

\x\=k 

see Section XI. 5. of |FKj (the Zx are called zonal polynomials there). By construction, they 
are invariant under conjugation by Uq and thus depend only on the eigenvalues of their 
argument. More precisely, for x £ Hg with eigenvalues ^ = (Ci, • • • , ^g) G M''', 

Zx{x) = C^{0, a = ^ 

where the are the Jack polynomials of index q in a suitable normalization (c.f. |FKj . 
|Kaj . [Rj). They are homogeneous of degree |A| and symmetric in their arguments. 

The matrix Bessel functions associated with the cone fig are now defined as o-^i-hyper- 
geometric series in terms of the Zx, as follows: 

A>0 ^^^^l-^l' 

where for A = (Ai, . . . Xq) E Nq, the generalized Pochhammer symbol {c)x is 

(/^)A=(M)f = n(/^-^(.--i)),^ 

and // G C is an index with (//)a 7^ for A > 0. This series converges absolutely for x £ Hq, 
see [i^Kj . Later on, we need the linear terms in the expansion of ^7^. By (|2.H) we have 

Mx) = l--trx + 0{\\xf). (2.2) 

To describe the main results of 0, we need the notion of a hypergroup, which will be 
introduced in the following section. 



2.2 Hypergroups 

A hypergroup (X, *) consists of a locally compact Hausdorff space X and a multiplication *, 
called convolution, on the Banach space Mi,{X) of all bounded regular complex Borel mea- 
sures with the total variation norm as norm, such that (Mfe(X), *) becomes a Banach algebra, 
and such that * is weakly continuous and probability preserving and preserves compact sup- 
ports of measures. Moreover, there exists an identity e £ X with 5e * Six = Six * Sie = Sx for 
x £ X, as well as a continuous involution x <^ x on X such that for x, y G X, e E supp{6x*Sy) 
is equivalent to x = y, and 6x*6y = {5y*5x)~- Here for n £ Mi,{X), the measure is given 
by fi~{A) = n{A~) for Borel sets Ac X. 

A hypergroup {X,*) is called commutative if and only if so is the convolution *, and 
hermitian, if the hypergroup involution is the identity. Hermitian hypergroups are commu- 
tative. 

It is well-known that each commutative hypergroup admits a (up to normalization) unique 
Haar measure uj £ M^{X) which is characterized by uj{f) = f{x * y) duj{y) for all x £ X 
and all compactly supported, continuous functions / £ Cc{X) where we use the notation 

f{x*y) := / f d{6x*Sy). 
Jx 
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Similar to the dual of a locally compact abelian group, we define the dual 



X := {a G Cb{X) : a / 0, a{x * y) = a{x)a{y) for all x,y £ X}. 

X is a locally compact Hausdorff space w.r.t. the topology of compact-uniform convergence, 
and its elements are called characters. The Fourier transform on L^(X,uj) is defined by 
/(a) := Jj^ f {x)a{x) doj{x) , a & X, and the Fourier-Stieltjes transform of measures is defined 
in the same way. It is well-known that for a fixed Haar measure uj on X there is a unique 
Plancherel measure vr on X such that the Fourier transform becomes an L^-isometry between 
and L'^{X,tt). 

Interesting examples of hypergroups are given as follows. 
2.3 Bessel convolutions on matrix cones 

For natural numbers p, q, consider the matrix space Mp^q = Mp^q(¥) of p x g-matrices over ¥. 
We regard Mp^g as a real vector space with the Euclidean scalar product {x\y) := 9^tr(x*y) 
and norm ||x|| = ^ytic{x*x). Consider the action of the unitary group Up on Mp^g by left 
multiplication, 

Up X Mp^q ^p,q > ^) ^ UX. 

This action is orthogonal w.r.t. the scalar product above, and x, y are in the same i/p-orbit if 
and only if x*x = y*y. The space Mp^g of all orbits for this action can therefore be identified 
with the space Ilg = ng(F) of positive semidefinite q x q matrices over F via 

Up.x i-^ V x*x =: \x\. 

Here for r £ Ilg , y/r is the unique positive semidefinite square root of r. This bijection is a 
homeomorphism w.r.t. the quotient topology on Mp^. 
Now consider the Banach-*-algebra 

Ml'"^{Mp^g) := {/i G MbiMp^g) : u{fi) = /i for ah u G Up} 

of all radial regular Borel measures on Mp^g, and the canonical projection 

p : Mp^g ^Ug, x^ 

with the usual unique square root on Ilg. Via this mapping, the convolution on M^°^{Mp^q) 
is transferred to a commutative, associative, probability preserving and weakly continuous 
convolution *p of measures on Yig which forms a commutative hypergroup. By construction 
(and results of |I^'Tj . [H] ) this convolution corresponds to a product formula for Bessel func- 
tions on lig with index = pd/2. In R , the convolution *p and the product formula 
for the corresponding is written down explicitly (see Eq. (|2.3|) below) in a way which 
allows for analytic continuation with respect to the index fi. This leads to "interpolating" 
commutative hypergroup structures Xg^^ on Ilg for all indices fi > p — 1 with 

P ■■= d{q - ^) + I. 

For fi < p — 1 having the form p = pd/2 with p G N, there exist also degenerated versions of 
the product formula 1)2. 3() below; it is however not clear at the moment whether these discrete 
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cases can be embedded into a continuous families of convolution and product formulas; see 
the discussion in [Rj . 

In the following we use the abbreviations Dg = {v € ^q,q '■ v*v < 1} and 

:= f A{I -v*vY-Pdv. 

JDq 

of where an explicit formula for is given in The following result contains some of 
the main results of [Rj . 

2.1 Theorem. Let /x G M with ^ > p — 1. Then 

(a) The assignment 

{5r*t,5s){f) := — [ f{Vr^ + + svr + rv*s ) A(I - vv*Y-P dv (2.3) 
Jd 

for f G Cc(n.q) defines a hermitian hypergroup structure on Ug with neutral element 
S Ilq . The support of 6r *^ Sg satisfies 

supp{6r *^ 6s) C G Ilg : ||t|| < ||r|| + ||s||}. 

(b) A Haar measure of this hypergroup Xq^^ := (Ilg,*^) is given by 




with 7 = ;u - |(g - 1) - 1 = ^ - |- 
(c) The dual space of is given by 

= Ws = v'^ ■■ s £ nj, 

and Xg^^ is self-dual via the homeomorphism s ^ ips- Under this identification of Xg^^ 
with Xg^^ , the Plancherel measure on Xg^^ is {2tt)^'^^'^lo^. 

Notice that in our normalization of the Haar measure for /i = pd/2, uj^ is just the image of 
the Lebesgue measure on Mp^g ~ M'^p^ under the canonical projection p : Mp^g ~ W^P'^ Ug. 

The explicit product formula 1)2. 3() may be used to describe the support of convolution 
products in more detail. Some special cases will be considered in Lemmas 14. 41 and 14. 1 51 below. 

3 Some results about hypergroups 

In this section we collect some further general notions and results about commutative hyper- 
groups. We also prove some more or less straightforward results about hypergroup automor- 
phisms which will be useful for the Bessel convolutions below. 

We start with the following simple observation will be useful several times. 

3.1 Lemma. If a locally compact space X carries two commutative hypergroup convolutions 
*i and *2 such that the dual {X,*i)^ is contained in {X,*2)^, then *i = *2- 
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Proof. Let a G {X, C {X, *2)^. Then, for all x,y£X, 

{Sx *i SyT{a) = a{x)a{y) = (4 *2 Sy)^{a). 

As the Fourier-Stieltjes transform of measures on {X,*i) is injective (see jj] or |BH) ). we 
obtain 5x *i 5y = 6x *2 for x,y £ X. □ 

3.2 Definition. Let X, Y be commutative hypergroups. A closed set if C X is called a 
subhy per group, if for all x,y £ H, we have x £ H and {x} * {y} := supp{5x * 6y) C H. 
Moreover, a continuous mapping T : X is a hypergroup homomorphism, if T{6x * Sy) = 
^T(x) * ^'T(y) all X, y G X where the mapping T : A" ^ y is extended to bounded Borel 
measures by taking images of measures. The notions of a hypergroup isomorphisms and 
automorphisms are similar. 

We need the following observations: 

3.3 Lemma. Let (Tfc)^.>i he a sequence of hypergroup automorphisms on a hypergroup (A,*) 
which converges pointwise to some continuous mapping T : X ^ X such that T(A) is closed 
in X. Then T is a hypergroup homomorphism from X onto the subhypergroup T{X). 

Proof. Let x,y £ X and / £ Ch{X). Then, by the weak continuity of the convolution, 

lim j f dTk{Sx * Sy) =^^j^j f di^nix) * ^rj^) = j f d{5T[x) * 
On the other hand, by the transformation formula and dominated convergence, 

lim j f dTk{5x * 6y) = lim j f oT^ d{6x * 6y) = J foT d{6x * 6y) = j f dT{6x * 6y). 

This proves T{dx * Sy) = 6x(x) * ^T(yj^ ^^^^ ^(^) is a subhypergroup. □ 

3.4 Proposition. Let X be a commutative hypergroup and T £ Aut{X). Then: 

(1) The Haar measure to of X satisfies T{uj) = ctuj for some constant ct > 0. 

(2) Forf,g£C,{X) and x £ X , {{f oT) * {g oT)){x) = ct ■ {f * g){T{x)). 

(3) There exists a dual homeomorphism T* : X ^ X with {T*{a)){x) = a{T{x)) for 
a £ X ,x £ X . This mapping T* maps the support supp tt C X of the Plancherel 
measure of X onto supp vr . 

(4) If X carries a dual hypergroup structure (A,*) which is uniquely determined by 

7(x) d[5a * Sp){"f) = a{x)l3[x) for a,/3 £ X, x £ X, 



X 

then T* as defined in (2) is a hypergroup automorphism on X . 
Proof. (1) For / £ Cc{X) and x £ X, 

T{uj){fx):= [ f{x*y)dT{uj){y)= [ f{x*T{w))doj{w) 
Jx Jx 



f oT{T-\x)*w)duj{w) = / f oT{w)dio{w)=T{io){f). 
X Jx 

Thus r(a;) is a Haar measure. The uniqueness of a; (0^) now yields the claim. 



8 



(2) For xeX, 

{{foT)*{goT)){x)= I {foT){x*y){goT){y)duj{y) 



X 



X 



f{T{x)*Tly))g{T{y))dw{y) 

f{T{x) * w)g{w) dT{u){w) = ct ■ {f * 9){T{x)). 



X 



(3) As for x,y £ X and a £ X 

{T{z)) d{6, * 6y){z) = I a{w) d{T{6, * 6y)){w) 



X 

a{w) d{6T(x) * h{y)))iw) = ot{T{x))a{T{y)), 



X 



(T*(a))(x) = a(T(x)) defines for for a G X a character T*(a) G X. Moreover, T* : 
X ^ Xis obviously a homeomorphism (remember tliat X is equipped with the topology 
of locally uniform convergence) . 

In order to check T*{suppTT) C suppir, take a G suppir. Then, by |Vflj . there is a 
sequence (/n)n>i C Cc{X) with fn*fn^'^ locally uniformly. Thus, 



a) 



locally uniformly, which conversely implies T{a) G suppir by [VOj . 
(4) For all X G X and a, f3 £ X we have 



T*{a * = l^^^liTix)) d{5^ * (,5^)(7) = a(T(x))/?(T(x)) 

and 



X 



(r*(a) * r*(/3))(x) = 7(x) * (<5^)(7) = T*(a)(x) • T*(/3)(x) 



a(r(x))/3(r(x)). 



□ 



4 Automorphisms, subhy per groups, and quotients 

In this section we collect algebraic properties of the Bessel convolutions on matrix cones. We 
fix parameters d, q, fi, p as in Section in Section 2 and consider the associated hypergroup 
structure Xq^^ on Uq. One major task will be the classification of all hypergroup automor- 
phisms of Xq^^. For this, we first determine a group of hypergroup automorphisms. For this, 
we recall that GL{q) := GL{q,¥) acts on Ilg as a group of homeomorphisms via 



Ta{r) := \/ar'^a* for a G GL{q), r G Uq. 
To check that the Ta are in fact hypergroup automorphisms, we observe: 
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4.1 Lemma. Let s,r £llq and a € Mg. Then ips{Ta{r)) = (/Tj,. ■ 

Proof. As the Bessel function J^^{r) depends on the spectrum of r G Hg only, we have 

□ 

4.2 Corollary. Let ^ G MbiHg), a G Mg, and s G Ug. Then Tjji}{s) = fi{Ta''{s)). 

Proof. Taifi){s) = Jifsir) dTa{lj){r) = J Lps{Ta{r)) dn{r) = J ^T,,(s)ir) d^i{r) = fi{Ta'{s)). 

□ 

4.3 Proposition. {Ta : a G GL{q)} is a group of hypergroup automorphisms of Xg^^. 

Proof. Fix a G GL{q). Then the homeomorphism Ta induces a further commutative hyper- 
group structure (11^,*^) on Ug by 

Sx *aSy:= Ta (<5r-i (^) * ^T-^y) ) (x, y G . 

It is easy to check that the dual space of this commutative hypergroup is {(/?soT„-i : s G Ug} 
where this space agrees with the dual of ^g,^ by Lemma l4. II Lemma l3 . 1 1 now shows that the 
hypergroups {'n.g,*a) and Xg^^ agree, and hence Ta is a hypergroup automorphism. As the 
Ta obviously form a group, the proof is complete. □ 

The preceding proposition may be also checked directly via the explicit product formula 
(|2.3() . but in our eyes this approach is more involved. Our approach has the further advantage 
that it works also for < p—1 in which Eq. p.3|) has a degenerated form (or is even unknown). 

We prove below that for F = M and n > p—1, the group {Ta : a G GL{q)} is the group of 
all hypergroup automorphisms of Xg,^- This is however not correct for F = C,H and q >2. 
For instance, for F = C and q > 2, complex conjugation on Ug is an automorphism which is 
not of the form above; for details see Theorems 14.81 and 14.91 below. 

We next determine all subhypergroups. For this we need: 

4.4 Lemma. Let ji> p — 1. Then for all r G Ilg and c g]0, 1], 

{r} * {cr} := supp{5r * 6cr) = {s £ Ug : (1 — c)r < s < (1 + c)r}. 

Proof. We find a suitable automorphism Ta which maps r into the diagonal matrix Lj := 
diag{l, . . . , 1, 0, . . . , 0) with rank j := rank r. We therefore may assume without loss of 
generality r = Lj. 

By Eq. we have 

{Ij} * {cLj} = {^{l + c'^)Lj+c{v + v*) €Ug: v e Mg, vv* < Ij}. 
To simplify this set, we observe for s G 11^ and h G Hg that 

s = ^(l + c2)I, +2c/i ^ h = is'^- ((1 + c^)Ij)/{2c), 

where for s,h coupled in this way, (1 — c)Ij < s < (1 + c)/j is equivalent to —Ij < h < Ij. 
Therefore, for a given s with this property we may take v = h £ Hg and obtain the inclusion 
D in the statement of the lemma. Conversely, for v G Mg with vv* < Ij, the spectral norm 
of V is bounded by 1; hence the spectral norm of h := (v + v*)/2 is also bounded by 1 
which means for this hermitian matrix —Ij < h < Ij. This proves the converse inclusion and 
completes the proof. □ 



10 



4.5 Remark. For n = p — 1, the statement of Lemma 14.41 is no longer correct. In fact, the 
degenerated exphcit product formula in Proposition 3.16 of R and some matrix computation 
shows that here for instance, for the identity matrix / the set {/}*{/} consists of those s Gllg 
with eigenvalues Ai, . . . , Ag G [0, 2] with X]f=i(A?/2 — 1)^ > 1, i.e., {/} * {/} contains a hole. 

In particular, for q = 1 and F = M (i.e. d = 1) and // = /O — 1 = 1/2 we have the 
degenerated Bessel convolution (|1.2() . This cosine hypergroup on [0, oo[ has the discrete 
subhyper groups cNq for c > 0. This example shows in particular that in the following 
proposition we partially must restrict our attention to the case n > p — 1. 

4.6 Proposition. Let p> p — 1, G {0, 1, . . . ,q}, and u £ Ug. Then 

Hk,u := |n ^ ^ |j ^ n* : f G life 

/ f \ 

(with Hq^u = {0}j is a subhypergroup of Xq^^, and the mapping r ^ u [ ^ ^ \ u* is a 

hypergroup isomorphism between X^^^ and H^^u- Moreover, for p > p — 1 all subhypergroup s 
of Xk^^ are given in this way. 

Proof. The Hf^j are obviously subhyper groups by Eq. 1)2. 3() . Using suitable automorphisms, 
it becomes also clear that the Hf^. ^ are subhypergroups for arbitrary u. In order to check 
the claimed isomorphism, we may assume u = I without loss of generality. It is possible 
to check the isomorphism property directly via Eq. (|2.3|) and some computation. We here 
however prefer another method and observe that the Jack polynomials in q and k variables 
respectively satisfy C^(0, . . . , 0, 6, • • • , Cfc) = C^iCi, • • • , 4) for < < . . . < by their 
very definition; see Stanley [H] Hence, by the definition of the q- and /c-dimensional Bessel 
functions respectively. 

Therefore, all characters of Xi^^^ appear as restrictions of characters on Xq^p to -fffc^^ where 
these restrictions are obviously characters on Hk^u- Lemma l3.ll now shows that the hyper- 
group structures on Hi^ u and Xu,f_i are equal as claimed. 

We still have to show that for > p — 1, all subhypergroups appear as some Hk^u- For 
this we show that each subhypergroup of Xq^^ which is not contained in some Hq-i^u with 
u £ Uq must be equal to Xq^^. As this says that each proper subhypergroup is contained 
in some we conclude from the first part of the proposition and induction that each 

subhypergroup appears as some Hk^u- In order to prove the claim above, consider some 
subhypergroup H which is not contained in some Hq-i^u- Let a £ H he an arbitrary element 
with rank k < q where we may assume without loss of generality a G H^j after using a 

(* * A 
j £ H with c G Ilq-k and c 7^ 0. 

Then, by Eq. (|2.3j) . a + b £ {a} * {b} C H, and a + b has rank at least k + 1. Iterating this 
argument, we find some r £ H with full rank. Lemma 14.41 now shows that {r} * {r} C H 
contains a neighborhood [/ of in Ilg. Applving 14.41 to elements of U several times, finally 
implies H = liq as claimed. □ 

4.7 Remark. Let a £ Mq be a matrix with rank k £ {0, . . . We find u,v £ Uq and a 
diagonal matrix b = diag{bi, . . . , 5fe, 0, . . . , 0) with bi, . . . ,bk 7^ such that a = ubv* holds. 
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The mapping with Ta{r) := V ar'^a* then obviously is a continuous and open mapping 
from liq onto the subhypergroup H^ u- Moreover, Ta is a hypergroup homomorphism. To 
check this, choose a sequence {a^jk C GL{q) with — > a. As then T^^. ^ pointwise on 
Xg^^, the assertion follows from Proposition 14.31 and Lemma 13.31 We next notice that the 



kernel of is 



for 



kernTa := {r E : r„(r) = 0} 



/ 




V :- 





f 

1 \ 





f E 



q—k,v 



V E Uq, 



\ 1 ••• 0/ 

and that kernTa is a subhypergroup isomorphic with Xq_fc,^ by Proposition 14.61 

Now let Hk^u {0 < k < q, u G Uq) be an arbitrary subhypergroup of Xq^^ As H^ u appears 
as kernel of some hypergroup homomorphism T from Xq^^ onto Xq^k,fi by the preceding 
considerations, we conclude from abstract results on hypergroup homomorphisms (see for 
instance |Vlj ) that the quotient space 

Xq^^/Hk^u ■■= {{x} * Hk,u ■ X E Xq^f,} 

(equipped with the quotient topology) carries a canonical quotient hypergroup structure with 
the convolution 



(where this convolution is independent of the representants x,y of the cosets; this may fail 
for arbitrary subhyper groups of arbitrary commutative hypergroups). Moreover, as in the 
group case, the hypergroup Xq^^/Hk^u is isomorphic with Xq_k^^. This fact implies (see 
|V2j and references there) that all subhypergroups of Xg,/^ have a number of nice analytic 
properties which are obvious in the case of locally compact abelian groups, but which may 
fail for general commutative hypergroups. We therefore may say that our Bessel hypergroups 
on matrix cones are hypergroups which is quite close to lea groups. 

In the end of this section, we classify all automorphisms for F = M, C. For this we denote 
the group of all hypergroup automorphisms of Xq^^ by Aut{Xq^y). For F = R we prove: 

4.8 Theorem. Let¥ = W and > p - I. Then Aut{Xq^^) = {Ta : a E GL{q)]. 

To describe all automorphisms for F = C and q > 2, fi > p—1, we denote the transposition 
x 1-^ X* on the space of Hermitian matrices by r. We know from Eq. (|2.3j) that its restriction 
to Ilq is contained in Aut{Xq^^). Moreover, for g > 2, r {Ta : a E GL{q,C)}. (In fact, 
for the proof of this fact we may restrict our attention to the case g = 2, in which case the 
statement can be checked by a direct computation.) 

Moreover, as r o o r = ?V(a) for all a E GL{q, C), it follows that 

{aoTa-. aeGL{q,C), {Id, r}} 



is a group of automorphisms of X, 
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4.9 Theorem. Let¥ = C and fi> p-1. Then 



Aut{Xg,^) = {aoTa: a G GL(g, C), a G {Id, r}}. 

Our proof of this classification is quite complicated, covers the remaining part of Section 4 
and may be skipped at a first reading. The proof is divided into several steps which partially 
work for all F. We start with q = 1, i.e., Xi^^ is a Bessel-Kingman hypergroup. This case 
was already handled in Zeuner |Zlj . but we include the proof for sake of completeness. 

4.10 Lemma. Let ji, F arbitrary. Then Aut{Xi^^) = {Ta ■ a > 0}. 

Proof. The convolution on Xi^^ = [0, oo[ satisfies {\a — b\, a + b} C {a} * {b} C [|a — 6|, a + 6] 
for all a,b > 0. Therefore, if T G Aut{Xi^fj_) satisfies T(l) = c for some c > 0, we obtain 
T(l/n) = c/n for all n G Z+ and thus, T{m/n) = cm/n for all m,n € Z+. Continuity then 
yields T{x) = cx for all x > 0. □ 

In the next steps we deal with the multi-dimensional case for arbitrary fields F. The first 
main result will be Proposition 14.141 below where we show that each T G Aut{Xi^^), which 
preserves diagonal matrices, preserves the norm for all matrices in 11^. 

4.11 Lemma. Let fi > p — 1 and T G Aut{Xq^fj_) . Then for each u £ Uq and k = 0, . . . ,q 

there exists u €z Uq with T{Hi.^u) = H/.^^. 

Proof. Consider the maximal chain 

{0} = Hq^u C Hi u C . . . C Hq^u = 

of subhypergroups such that all inclusions are proper. The classification of all subhyper groups 
in Proposition 14.61 now leads to the claim. □ 

In the following, we denote the diagonal matrix diag{0, . . . , 0, 1, 0, . . . , 0) G Ilg with 1 at 
the i-th. element by {i = 1, . . . , q). 

4.12 Lemma. Let p > p — 1 and T G Aut{Xq^^). Then there exists a G Gl{q) such that 
Ta o T{c ■ e-i) = c - e-i for all c> and i = 1, . . . ,q. 

Proof. For i = 1, . . . ,q consider := T{ei) G Ilg. These matrices have rank 1 by Lemma [4.11l 
We thus find vectors Xi G F'^ with *. We claim that the Xi are linearly independent. 

In fact, if they would be dependent, we would find x G F'' \ {0} with rjX = XiX*x = for all 
i. In other words, ri, . . . ,rq would be contained in a proper subhypergroup of Ilg. But this 
is impossible by Lemma 14.111 as Ilg is the only subhypergroup containing all e^. We thus see 
that the Xi are linearly independent. Hence we find a unique a G Gl{q) such that for all i, axi 
is the ith unit vector. This implies Ta o T{ei) = for all i. We thus conclude from Lemma 
I4.11l that o r is an automorphism on the one-dimensional hypergroups {c • : c > 0} with 
Ta o T{ei) = Ci. Therefore, by Lemma [4.101 o T is the identity on these subhypergroups. 
This proves the lemma. □ 

4.13 Lemma. Let T G Aut{Xq^^) with T{c • ej) = c • for all c> and i = 1, . . . ,q. Then 
T{r) = r for all diagonal matrices r G Ilg. 
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Proof. Let T* be the dual automorphism according to ProDosition l3.4I We first fix i = 1, . . . , g, 
c > and s Gllq and notice 

The Taylor expansion ^2.'2\t of now yields 

1 - ^tr{e^T*{sf) + O(c^) = 1 - ^tr{eh') + 0{c') 

for c ^ 0. As this holds for all i, the matrices T*(s)^ and have the same diagonal parts 
for any s. 

Now let r = "^f^i CiSi £ Hq be an arbitrary diagonal matrix. Using v't*(cs)(^) = ^cs(T{r)) 
and the Taylor expansion ()2.2|) . we obtain 

1 _ ^t,(r(r)2.2) + 0{c') = j/-r'T*{csr) 

where, by our considerations above, r'^T*{cs)'^ = cPr'^s'^ + h for some matrix h = h{c,s,r) 
with zeros on the diagonal. Moreover, as T* (cs) as well as cs are both positive semidefinite, 
and as the absolute values of all entries of a positive semidefinite matrix are bounded by the 
maximum of the absolute values of the diagonal entries, we have h{c, r, s) = 0{c'^) for c ^ 0. 
Hence, again by (|2.2|) , 

j,(Vr*M2) = j,(lcW) + o(c4). 

Combining all results, we obtain 

1 - ^tr{rh'^) + O(c^) = Jf,{^c\h^) + O(c^) = 1 - ^tr{T{rfs'^) + O(c^) 

for c — > 0. Hence, tr[r^s'^) = tr{T{r)'^s'^) for all s £ Uq and thus all s S Hq. As the trace 
forms a scalar product, we obtain r(r) = r as claimed. □ 

4.14 Proposition. Let /i > p — 1 and T € Aut{Xq^^). Then there exist a G Gl{q) and a 
mapping h : Uq ^ Uq with h{I) = I such that Ta o T{uru*) = T^^'^{uru*) for all diagonal 
matrices r G Hg and all u G Uq. In particular, for this a, we have \\Ta o T{x)\\ = \\x\\ for all 

X G Hq. 

Proof. By Lemmas 14. 121 and \A.1'6\ we find a G Gl{q) such that Ta o T{r) = r for all diagonal 
matrices r G Hg. The same argument together with change of basis show that for each 
u £ Uq there exists h{u) G GL{q) such that Ta o T{uru*) = Th(^u-^{uru*) for all diagonal 
matrices r G liq. Taking r = I, we see that for any u G Uq, I = Ta o T{I) = Ta o T{ulu*) = 
Th{u){ulu*) = Tfi(^y_'j{I), and hence h{u) G Uq. The lemma is now obvious. □ 

We next restrict our attention to the case q = 2 where we derive the classification for 
F = R, C. The key will be: 

4.15 Lemma. Let q = 2 and ^> p — 1. Then, for all a, c g]0, oo[, 

({(o o)}*{(2 ^)})n{.en,:H>y^}^W,): 1,1^1}. 
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where, for (3 £¥ with = 1, 



-.2 .fl. \V2 



a~pc ) ~ a2 + c2 V -/^c a y V j V /3c a 



Proof. Let u = ^ ^ ^2 with vv* < I. Therefore, the (1, l)-entry \ar + \(3r of vv* 

\ J d J 

satisfies |ap + < 1. Hence, < 1. Moreover, for each /? G F with |/3| < 1 we obviously 
find a corresponding v with t^?;* < I. Using the convolution formula Eq. H2.3() and the fact 
that the matrix 

J + ( c J + I r[o c J + I c J M =[a-pc a' 



has norm (a^ + + 2a2c'^|/?p)^''2, the statements of the lemma now follow easily. □ 

4.16 Corollary. Let T G Aut{X2^^) with T{r) = r for diagonal matrices r E 112. Then, for 
all a, c > and /3 G F with \(5\ = 1 and with the notion of Lemma \4-15\ T{s{(3)) £ {^(t) : 
7GF, |7| = 1}. 

Proof. T preserves the matrices ^ ^ ^ ^ and ^ |j ^ ^ for a, c > 0. As T also preserves 
norms by Proposition 14.141 the statement follows from Lemma 14.151 □ 

Corollary 14.161 now leads easily to the claimed classification for q = 2 and F = M. 

4.17 Proposition. For ¥ = R, Aut{X2,^,) = {Ta : a G GL{2)}. 

Proof. According to Lemmas 14. 121 and 14.131 it suffices to prove that any T £ Aut{X2^ij,) with 
T(r) = r for diagonal matrices r G 112 has the form T = for some u G 0(2). For this 
take a, c > and /? = ±1 and consider the matrices s{f3) as above. Then, by Corollarv 14.161 

r(.(/3))G{.(i),.(-i)}. 

Assume now that sq := I , . I satisfies T{sq) = sq. The continuity of T then implies 



^11^ 

that T{s{0)) = s{(3) for all a, c and (3=1. Clearly, this statement then must also hold for 
all a, c and [3 = —1. As by the diagonalization of s{f3) in Lemma 14.151 each rank one matrix 
in 112 appears as some s(/3), we conclude that T is the identity for all rank one matrices. 
Proposition 14.141 now implies that T is the identity for all matrices in Ilg. 

Furthermore, if T{sq) = ^ l''^ ) ' ^'^^^ ^-^ same arguments T{s{0)) = 

s{—(3) for all a,c and (3 and thus T = for u = ^ ^ '^^ ^ on Hq. This proves the 
claim. □ 

We next deal with q = 2 and F = C, H. We here need the following observation: 

4.18 Lemma. Let T G Aut{X2^^) with T{r) = r for all diagonal matrices r G 112. Then 
there exists v £ U2 such that T„ o T(r) = r for all r G 112 which are diagonal or which have 

the form r = ( ^ ^ ^ ^ ] with s,t > 0. 

\ s -t s + t I ' - 
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Proof. By Corollary KT^ there exist numbers /3i(s), /32(i) £ F with \Pi{s)\ = \P2it)\ = 1 such 
that 



s s 



SP1{S) \ ( t -tW _( t -tp2{t) 



s sJJ \ sf3i{s) s y' \\ -i t J J \ -tP2{t) t 

(4.2) 

for all s,t>0. On the other hand, 

^*^> = {uoru^ : r diagonal} =: H 

for ^0 ^ I \ ) ^ thus, by Proposition 14.141 T{w) = v*wv for all w G H 

and some v £ U2- In particular, T is R- linear on H which ensures that /?i,/32 in Ea. ()4.2() are 
constants independent of s,t > 0. Therefore, 



T 



s + t s-t\\_/' s + t j3is-j32t 

s-t S + t J J ~ \ 0iS - 02t s + t 



for s,t > 0. As T is norm-preserving, it follows that |s — t| = \s — tPi/P2\ for all s,t > 0. 
This yields f3i = P2 =■ P, and thus T{w) = v*wv for v = ( ^ 5 ) ^ ^2, Therefore, v has 



p 

the properties claimed in the lemma. □ 

We next derive the classification for F = C and q = 2. 
4.19 Proposition. For ¥ = C, 

Aut{X2,^) = {aoTa: a£ GL(2,C), a £ {Id,T}}. 

Proof. According to Lemmas 14.121 and I4.1HI and I4.18| it suffices to consider T G Aut{X2^^) 

s + t s — t 



with T(r) = r for all r G 112 which are diagonal or which have the form r 



s — t s + t 



with s,t > 0. Let s,t > and let ^0 := ^ | ^-^^ ^ U2 with Uq^ = uq. As T^q preserves 

the norm on 112, we conclude from Lemma 4.14 and the fact that T„q is a hypergroup 
automorphism that 



= {tiP) : /3 G C, |/?| = 1} (4.3) 



with 




J_fs^+t^ + St{p + P) s2 - t2 + st{p - (3) 

^{s^-t^ + stCP -13) s^ + t^- st{p + 13) 



1/2 



As 



roT„.,,,j:))^r..,((j»))..ror„,.((»»)).r,,((»» 
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by our assumption, we see that for all /3 G C with \(3\ = 1 there exists 7 = 7(/3) G C with 
I7I = 1 such that T{t{(3)) = t{^). On the other hand, t((3) is a rank one matrix and has 
thus the form s{6) for some 6 £ C with \6\ = 1 in the notion of Lemma 14.151 Therefore, by 
Coroharv 14.161 the diagonal entries of are preserved under T. Hence, /? and 7(/3) have 
the same real parts, and thus T{t{(3)) £ {t{(3),t{P)}. A continuity argument shows that we 
have either T{t{(3)) = t{(3) for all s,t > and all = 1, orthat we always have the other 
case. As each rank one matrix r G 112 appears as some t{P) (for suitable s, t, l3), we conclude 
from Proposition 14. 14l that T is either the identity or the transposition r on 112. D 

We next restate Propositions 14.171 and I?. 191 For this, we define for i,j = 1,. . . ,q with 
i ^ j the space U^'^ {q) of all unitary v £ Uq with Vk,k = 1 for all k ^ i.e., there are at 
most two possible non-trivial non-diagonal entries of v in the positions and The 
following statement now follows immediately from the proof of Propositions 14.171 and 14.191 
by a suitable basis change. 

4.20 Lemma. Let = M, C, g > 2, li G Ug, and T G Aut{Xg^f,) with T{uru*) = uru* for 
all diagonal matrices r. Let i,j = l,...,q with i 7^ j. Then there exists u{i,j) G Ug and 
(f G {/d, r} such that T{vuru*v*) = ip o T^fi^j-^{vuru* v*) for all v G U^'^{q) and all diagonal 
matrices r G Ilg. For F = M only the case (p = Ld appears. 

We are now ready to complete the classification. 

Proof of Theorems 14-^ and \4.S\ It suffices to consider the slightly more complicated case 
F = C Moreover, as in the proof of Propositions 14.171 and 14.191 it suffices to prove that 
each T G Aut{Xg^^) with T{r) = r for diagonal matrices r G Ug has the form T = T„ or 
T = T oTu for some u G U{q). To prove this we recapitulate that there exist N = N{q) and 
ii, . . . , ZAT, ji, . . . , jAT G {1, . . . , g} with i„ / j„ forn = 1, . . . , iV such that 

Ug = W^'^^iq) ■ U'^'^^iq) ■ ■ ■ C/*^'^'^(g). 

Moreover, Lemma I4.2U1 and induction show that for n = 0, 1, . . . , there exist Un G Ug and 
(^1, . . . , 99 AT G {Id, t} such that 

T{VnVn-l ■ ■ ■ Virv\ . . . = Pn ° Tu„{VnVn-l ■ ■ ■ Virv^ . . . 

for all diagonal matrices r £ Ug and all vi G 0^^'^^{q), . . . ,Vn G 0*"'-'"((jf). The theorem now 
follows for n = A^. □ 

We finally consider the case F = H. By the preceding proof, the classification only 
depends on the computation of Aut{X2^fj.). We suggest that here the study of concrete 
additional matrices as in Lemma 14.181 and Proposition 14. 19l leads to the following conjecture: 

Consider the group Gh of automorphisms of the field EI =< l,i,j,k >k which fix the real 
line, which is generated by the 3 automorphisms which switch two of the i,j,k and change 
the sign of the third component. In this -Ds-case we then we have |Ge| = 24, and we may 
let act Ge on X2^^ by using the same transformation in each component of a matrix. It can 
be easily checked by Eq. (|2.3j) that Ge then forms a group of hypergroup automorphisms 
on A2,^. Moreover, for r G Ge and a G GL{q) we have r^^ o o r = T^(^a)- Therefore, 
{r o Ta : a G GL{q), r G Ge} forms a group of hypergroup automorphisms on A2_^. We 
expect that 

AutiXg^i,) = {ToTa: a G GL(g), r G Gh}. 
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5 Convolution semigroups and Wishart distributions 



In this section we first introduce convolution semigroups and associated random walks on 
Xq^^. This concept is weh-known for commutative hypergroups; see {BH] . |ReVj . and 
references there. We shah see that in particular general so-called squared Wishart dis- 
tributions form such convolution semigroups. In this way several known results about 
Wishart distributions and Wishart processes may be partially seen under a new light, see 
(B],|nLj,|SS|,lDl],|nY|, IFK],|H], and in particular. [Jaj and We here notice that these 

Wishart distributions will appear later as limits in a central limit theorem in the next section. 
We first recapitulate the notions of convolution semigroups and associated random walks. 

5.1 Definition. (1) A family {fJ-t)t>o C M^{Xg^fj_) of probability measures on ^g,^ is called 
a (continuous) convolution semigroup on Xg^^^, if fig * fJ-t = fJ-s+t for all s,t > with 
fiQ = (5e, and if the mapping [0, oo[— > M^{Xg^^), t fj^t is weakly continuous. 

(2) A convolution semigroup {nt)t>o is called Gaussian if 

lirn -/it(iir \U) = for all open subsets U C Xg^^ with G f7. 

(3) Let (/Uj)t>o be a convolution semigroup on Xg^^. A Xg^^-valued time-homogeneous 
Markov process {Xt)t>o is called a Levy process on Xg^^ associated with {nt)t>o, if its 
transition probabilities satisfy 

P{XteA\Xs = x) = {fit-s*6^){A) 

for all < s < t, X E Xg^^, and Borel sets A C Xg^^. By well-known general principles 
for Feller processes, a Levy process on Xg^^ always admits a version with rcll paths, and 
a Levy process is Gaussian, i.e., is associated with a Gaussian convolution semigroup, 
if and only if it admits a version with continuous paths; see |R eVj . 

(4) Similar to the continuous case, we say that random walk {Sn)n>o on Xg^^ associated 
with a sequence (/in)n>i C M^ijlg) is a Markov chain with initial distribution Ps^ = 
and the transition probabilities 

P{Sn G ^1 Sn-1 =X) = {6, * fln){A) (5.1) 

for n > 1, X S n„ and Borel sets A C Ilg. If all /u„ are equal to some /i, then {Sn)n>o 
is time-homogeneous, and we say that it is associated with the measure fi. 

It is easy to check that for a random walk {Sn)n>o on Xg^^ associated with (/u„)„>i 
and n > 0, Sn has distribution Ps„ = fii * fi2 * ■ ■ ■ * fJ-n * Pso- 

We next turn to Wishart distributions which form examples of Gaussian convolution 
semigroups. Before defining them, we point out at the beginning that our notion of Wishart 
distributions is equivalent to, but slightly different from the classical one, as here in the group 
case ^ = dp/2, a positive semidefinite matrix r G Ilg corresponds to \/x*x for x S Mp^g and 
not to x*x as usual. In this way, images of {7p-invariant normal distributions on Mp^g under 
the projection Mp^g —>■ Hg, x ^ Vx*x, will be images of classical Wishart distributions on 
Ilg under r yjr on Ilg. Also for general parameters /i, we use these images of classical 
Wishart distributions under this square root mapping, and call these distributions squared 
Wishart distributions. For instance, for g = (i = 1, classical Wishart distributions are 
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gamma distributions while squared ones are Rayleigh distributions. In this way, our notion 
is in agreement with Kingman [Kj for q = d = 1 and close to the classical Euclidean setting. 
This notion has also the advantage that the limit theorems in Sections 6 and 7 will be in our 
notion very close to the classical Euclidean setting. 

5.2 Definition. The standard squared Wishart distribution W = W{d, q, fi) on Ilq = nq(F) 
with shape parameter fi > p — 1 is the probability measure 

on Uq. This is fact a probability measure; this follows for instance from Lemma 15.41 below 
for s = 0: 

We next turn to general squared Wishart distributions and observe first that uj^ and 
hence W are invariant under the unitary transforms r i— > uru* on Uq for u £ Uq. As any 
a E Mq may be written as a = su with s = \/aa* E Uq and u £ Uq, the image Ta{W) under 
the mapping Ta{r) = Var^a* agrees with Ts{W), i.e., Ta{W) depends only on s = \/aa*. 

5.3 Definition. The squared Wishart distribution VF(s^) = W{d,q, fi; s"^) on Uq = Uq(¥) 
with shape parameter ^ > p — 1 and covariance for s E is defined as image of W under 
Ts (or, by the preceding discussion, under for any a E Mq with = aa*). 

The transformation formula yields that for regular s E Uq, the distribution VF(s^) has 
the a;^-density 

/^2(r) := ^] ^ g~tr(.-V^.-i)/2 u), (5.2) 

Moreover, if s E Ilg is singular with rank k < q, then W{s'^) = Ts{W) is supported by the 
proper subhypergroup Ts{Ilq) which can be identified with X^^^; cf. Proposition 14.61 We 
show below that if we regard W{s'^) = Ts{W) as a measure on X^^^, it again admits a density 
like Eq. 1)5. 2() with respect to the Haar measure on X^^^. 

We next determine the Fourier transforms of squared Wishart distributions (in the hy- 
pergroup sense). 

5.4 Lemma. For a E Mq, the Fourier transform ofW{aa*) is given by 

W{^*){s) = e-*'-("'«'«)/2 (s E Uq). 
Proof. Proposition XV.2.1 of |FK] yields 

f e-*^'(^^)j-^(x)A(x)^""/^ dx = rf,,(^)A(y)^^e-*^<^"'). 

Change of variables = s^/2 and x = sr'^s/A the readily leads to the claim for the standard 
case a = I. Finally Lemma 14.21 shows that for any a E Mq, 

W{^*){r) = T]AW){r) = W{Ta*{s)) = e-*''K^''^)/2 = e-ir(aa*«2)/2_ 

□ 
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If we introduce the exponentials E L'^{Q^) with ez{r) := e tr{r''z'^)/2 ^ ^ -q^^ 
may write the preceding lemma briefly as 

e; = (27r)'?^A(z)-^e,-i. (5.3) 

As announced above, we now briefly discuss the density of degenerated squared Wishart 
distributions. We restrict our attention to a special case without loss of generality (cf. Section 
14. 7|) : the general case would need to much additional notation. 

Let a = diag{l, . . . , 1, 0, . . . , 0) be a diagonal matrix with rank k £ {0, . . . , q}. Then the 
squared Wishart distribution W{a) is supported by the subhypergroup H/^ j which can be 

/ J- Q \ 

identified with X^^^ via ( ^ ^ j ~ r; see Proposition 14.61 Moreover, characters of Hf^ j can 
be written as 

see the proof of Proposition 14.61 Therefore, for s £ H^ j, 

Wiaj{s)=I]AW){s)= [ ^sdTa{W)= [ ipsoTadW = W 

Thus, by Lemma 15.41 the Fourier transforms of W{a) and the standard squared Wishart 
distribution on H^ j are equal. The injectivity of the hypergroup Fourier transform then yields 
that, under the identification above, W{a) is just the standard squared Wishart distribution 
on Hkj. 

We note that this result may be also obtained by direct computation. The details here 
(e.g. regarding the constants) are however in our opinion more complicated than in our 
approach. Singular Wishart distributions are also considered (after the transformation r i— > 
VF) in [CLj, ILM,. 

We next collect some trivial properties of squared Wishart distributions. 

5.5 Lemma. For all a,b £ Hq: 

(1) Ta{W{b^)) = W{ab^a); 

(2) VF(&2) * W{a^) = W[a^ + 62); 

(3) (//f := VF(ta2))t>o is a Gaussian convolution semigroup with 

imit~Vt(n,\f/) = o. 

Proof. The first two statements follow from injectivity of the Fourier transform. Moreover, 
(2), the explicit formulas for the Fourier transforms, and Levy's continuity theorem for the 
hypergroup Fourier transform (Ch. 4.2 of |BHj ) imply that {p,t := W{ta'^))t>o is a convolution 
semigroup. For the proof of being Gaussian, we may assume a as identity matrix, in which 
case the definition may be checked easily by using the transformation formula. □ 

We expect that all Gaussian convolution semigroups on Xq^fj^ are given by squared Wishart 
distributions in this way. In fact, for the group cases /i = dp/2 this can be easily deduced 
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from the well-known corresponding result on the group Mq p ~ W^P^. In the other cases we 
shall investigate this point in a forthcoming paper. We also point out that the generator of 
the Wishart semigroups is known; see Bru [B] . 

In the end of this section we determine translates 6x * IV (s^) of squared Wishart dis- 
tributions, as these shifted squared Wishart distributions appear in the transition kernels 
of Gaussian processes; cf. Section I??1T 2). We here follow ideas of C. Herz ^ and use the 
following generalization of a result of Tricomi (see also |Dij): 

5.6 Lemma. Let f,g G L'^{Q^), and ip{z) := {ez,f) and V'(^) ■= {^z,g) for z G ^fj,)- Then 
f = g if and only if ip{z) = {2^Ty1^'A{zy^'^p{z~'^). 

Proof. Let g = f ■ Eq. (|5.3|) . and the Plancherel formula |2.ir c) imply 

^(z): = (e„/) = (2^)-2«^e;,5) 

= (27r)-«'^A(z)-^(e,-i5) = (27r)-«'^A(z)-^^(z-i). 

Conversely, a Stone- Weierstrass argument shows that the span a dense subspace of L^(r2^) 
which yields the converse statement. □ 

5.7 Lemma. For any s G $7^ and x G 11^, 

Proof. Again, using a suitable automorphism, we may restrict our attention to the standard 
case. Fix x G Ilg and consider the functions /(s) := e~*^^^ ^^'^J^i{—\x^s^) and g{r) := 
^-tr{r^)/2 L^(a;^). Then the associated functions cp, ijj according to the preceding 

lemma are given by 

V{z) := I e-*^(^^+-^)/2j-^(-ix2.2)e-*'-(^^^^)/2 cko{s) = e-'^^^'^'e^^iix) 

and 

Hz) := I e^*^'(^")/2 J-^(-lxV2)e-*^<^"^')/2 dLo{r) = e;5^(x). 

Eq. (|5.:-{|) and analytic continuation yield ip{z) = A{z)~'^^|J{z~^), and hence, by Lemma I^Hl 
{2tt)~'^^ f = g = {W *5x)'^ on Ilg. As the hypergroup Fourier transform is injective, the proof 
is complete. □ 

6 Limit theorems 

In this section we derive a central limit theorem as well as strong laws of large numbers for 
random walks on matrix Bessel hypergroups which reduces in the group cases n = pd/2 just 
to radial parts of the classical central limit theorem on the vector space Mp^q for sums of iid 
random variables and the corresponding classical strong laws of large numbers of Kolmogorov. 
The proof of the central limit theorem is standard and uses a Taylor expansion of the Fourier 
transforms as well as Levy's continuity theorem for hypergroups. Before stating the CLT, we 
introduce so-called moment functions on matrix Bessel hypergroups. Such moment functions 
on hypergroups were introduced by Zeuner and used later for several limit theorems on 
hypergroups; see the monograph ,BH for more details and references. 
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To introduce moment functions, we recapitulate that we regard and Hg as real vector 
spaces with scalar product (a;|y) := ^tr{xy*) and norm ||x|| = (xlx)^/"^. For k G and a 
function g in the variable s G Hq, we denote the k-th. differential of g by dgg{s) where this is a 
A:-linear map on Hq. Following the literature on limit theorems on hypergroups (see Chapter 
7 of |BHj . |Z2j and references cited there), we introduce moment functions and moments of 
probability measures on Jim- 

6.1 Definition. For k G and si, . . . , G Hg define the moment function 

ml''-'"^{r) := ■ dJ(/j,(r)|,=o(si, • • • , Sfc) 
on Hg. As ips{r) = J^ijsr'^s) and J^{x) = 1 — +o(||x|p) for x — > 0, we have for r G 11^: 

(1) m^2k+i^''^^ ~ ^ ^ •Si) • • • ) ■52A;+i G Hq, and 

(2) m2''''(r) = ^lHtr(sir2s2). 

(3) In particular, ml^^r) = ^H'^lP- 
(3) mo = 1. 

We say that a probability measure /U G M^(nij) has a A;-th moment, if 

/ ||r||'^ dfi{r) < oo. 

In order to get estimates for moment functions and derivatives of /x, we use the following 
Bochner-type integral representation for (/?s(r) of jRj : 

>f,{r)= — [ e-'^^^^'^l^il -vv*Y~Pdv. (6.1) 

6.2 Lemma. For k G Z+ and sq, si, . . . , s^, r G Hg, 

fc 

dlfs{r)\s=so{si, ■■■,Sk) 

1=1 

and in particular, |m-2^''"''*^'^| < \\r\\'^'' ■ Y['i=i 

Proof. As D is compact, we may interchange derivatives and integration in Eq. ()6.H) . Thus, 

d':^s{r)\s=so(.si,...,Sk)= I T\{rv\si)-e-'''''^\'^^{I-vv*r~Pdv. 

As for f G -D, < vv* < I and hence < rvv*r < r^, we obtain 

|(rt;|si)| < ||rt;|| • ||s;|| < ||r|| • \\si\\, 
and the lemma follows by taking absolute values. □ 
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6.3 Proposition. Let u € M^ijlq) and k >1. If the 2k-th moment of u exists, then v is 
2k-times continuously differentiable on Hq with d^^~^z)(0) = 0. Moreover, for I < 2k, 

d^v{s) = I d[<fs{r) dv{r) {s e Hg), 

and, in particular for I < k and Si, . . . ,S2i G Hg, 

d2^i>(0)(si,...,52z)= / m'^l-''^{r)du{r). 

Proof. The estimation in Lemma 16.21 and standard results on derivatives of parameter inte- 
grals ensure that partial differentiation up to order 2k and integration may be interchanged 
in i>(s) = dv{r). Therefore, under this condition, all statements are clear by the 

definition of moment functions. □ 

We are now in the position to prove the following central limit theorem. In the group case 
^ = dp/2 it is equivalent to the classical central limit theorem on the Euclidean space Mp^q 
for sums of i.i.d. random variables with a distribution which is invariant under the action of 
Up on Mp^q. 

6.4 Theorem. Let v G M^(ng) such that the 2k-th moment of u exists. Then, the matrix 
o"^ := Jjj r'^dv{r) £ Ilg exists, and the probability measures r^_i/2j(z^*-"^) = (X^-i/2/(j^))^"^ 
tend weakly to the squared Wishart distribution W{a'^) for n — > oo. 

Proof. We first note that 

m^'^ir) dvir) = — / tr(sr'^s) dvir) = — tr is- [ r'^duir) ■ s | 
= tr{sa^s). 

Hence, the preceding proposition and the Taylor formula imply that f) is twice continuously 
diff'erentiable with 

Hs) = 1 - ^dMO)is, s) + oiWsf) = 1 - ^trisa^s) + o{\\sf) 

for s — > 0. Hence, by Lemma 14.21 for any s £ Hq, 

lim ((r„_i/2^(z.))("))^(s) = lim (l - ^tr{.sah) + o{n-^)] = e-*^(^'^'^)/2. 

n—*oo n^oo \ Zn J 

Lemma 15.41 and Levy's continuity theorem for the hypergroup Fourier transform (see Section 
4.2 of IjBHj) now complete the proof. □ 

We next turn to strong laws of large numbers for random walks on Xg,^. For this we 
use the algebraic properties of the moment functions on Xq^^ which then will be used to 
construct martingales. 
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6.5 Lemma. For all k > and si, . . . , Sk, x,y £ liq, 



I 



k 



/=0 l<ji<j2<...<ii<fc 



where si, . . . , Sk \ Si^, . . . , stands for the Sj with j ^ {ii, . . . ,ii} . In particular, 

m2^''^ d{5^ * 6y) = m'^'^'^x) + m'^'^'^y) 
and, in the language of matrix valued integrals, 

d{6^*5y){r) =x^ + y^. 
Proof. As the (ps are multiplicative, the definition of moment functions yields 

d{6a: * 5y) = i^ ■ d';{Lps{x)(ps{y))\s=Q{si, Sk). 



The first statement now follows readily from a multivariate version of the Leibniz product 
rule for derivatives. The last equation follows from the preceding one by taking matrices 
si, S2 G Hg which have only zero entries except for precisely one 1 on the diagonal. □ 

We now construct martingales from random walks {Sn)n>o on Xq^^ associated with a 
sequence (/in)n>i C M^{Ilq). For this we realize {Sn)n>o on some probability space which 
carries the canonical filtration associated with {Sn)n>o- Expectations will be denoted by E. 

Based on the preceding observations, it is standard to derive the following observations 
(cf. Section 7.3 of |BH] or [Z2l): 

6.6 Lemma. (1) For each s G Hq, the M-valued process 

UsiSn)-flMs))-A 

\ k=l / n>0 

is a martingale. 

(2) Assume that all /i„ admit second moments. Then for all si, S2 G Hg, 



n „ 

EKi'^^(5„)) = J] / m^^'^^ dfik {n > 0), 
J, 1 ^ 



k=l 



and (mg^' '^{Sn) — E(m2^' ^(5'„)))„>o is a martingale. 

In matrix language, E(S'^) = X]fc=i / dfik{r) for n > 0, and {S^ — E(5'^)„>o is a 
matrix-valued martingale. 

Also higher moment functions can be used to construct martingales under suitable mo- 
ment conditions. This was worked out for instance in |EVj for the closely related case of 
Markov chains on Weyl chambers which are associated with Dunkl operators. For a general 
discussion of moment functions and associated martingales see also |BHj , |ReVj , |Z2j . 

Based on strong laws for martingales and the concept of moment functions, Zeuner |Z2j 
derived general strong laws of large numbers for random walks on general commutative 
hypergroups; see also Section 7.3 of |BHj . In the present setting, Zeuner 's results lead to the 
following strong laws which correspond in the group case = pd/2 precisely to the classical 
strong laws of large numbers of Kolmogorov on the Euclidean spaces Mm,p- 
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6.7 Theorem. Let {S„)n>o be a random walk on Xg^^ associated with the measusures 



(1) If {an)n>i C]0,oo[ satisfies a„ ^ oo and 



n=l "'^ 



|r||^ d^n{r) I < oo, 



then lim„_+oo Sn/an = almost surely. 
(2) Let A €]0, 2[ and {Sn)n>o time-homogeneous with J ||r|p(i/i(r) < oo. Then n~^^^Sn 
for n — > oo almost surely. 

Proof. Apply Theorem 7.8 and Corollary 7.11 of IZ2I respectively to the moment function 

6.8 Remark. Let /i > p— 1. The compact group Uq C GL[q) acts as group of automorphisms 
on the hypergroup Xq^^ such that the space Xql'Jj, of orbits may be identified with the Weyl 
chamber 

Wq := {(Ai, . . . , A,) G : < Ai < A2 < . . . < A J 

of type Bq. It is shown in R that ~ Wq carries a commutative orbit hypergroup struc- 
ture whose characters are symmetric Dunkl kernels of type Bq] cf. |Duj . With the canonical 
projection from Xg^^ onto Xq^fi ~ Wq, the preceding limit theorems can be immediately be 
transferred into limit theorems for random walks on this i?g-Dunkl-type hypergroup structure 
on Wq. This leads to connections with limit results in [EVj . 
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